\hypertarget{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser}{\section{com.\-spider.\-jspiderlibrary2.\-Robots\-Parser \-Class \-Reference}
\label{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser}\index{com.\-spider.\-jspiderlibrary2.\-Robots\-Parser@{com.\-spider.\-jspiderlibrary2.\-Robots\-Parser}}
}
\subsection*{\-Static \-Public \-Member \-Functions}
\begin{DoxyCompactItemize}
\item 
static boolean \hyperlink{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a763eb021063080b7cbfc3a0477b89b38}{robot\-Safe} (\-U\-R\-L url)
\end{DoxyCompactItemize}
\subsection*{\-Static \-Public \-Attributes}
\begin{DoxyCompactItemize}
\item 
static final \-String \hyperlink{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a0455347c6ace914cb64885d5cb4e051b}{\-S\-E\-A\-R\-C\-H} = \char`\"{}\-Search\char`\"{}
\item 
static final \-String \hyperlink{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_aff7a48bec0d0fa25e624afcc60144f32}{\-S\-T\-O\-P} = \char`\"{}\-Stop\char`\"{}
\item 
static final \-String \hyperlink{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a0d4b2f94e6784a8bff783928ef5d5a78}{\-D\-I\-S\-A\-L\-L\-O\-W} = \char`\"{}\-Disallow\-:\char`\"{}
\item 
static final int \hyperlink{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_ad78a55ba0cb474ee527ee4c2a73c3923}{\-S\-E\-A\-R\-C\-H\-\_\-\-L\-I\-M\-I\-T} = 50
\end{DoxyCompactItemize}


\subsection{\-Detailed \-Description}
\begin{DoxyAuthor}{\-Author}
altamirano,peker,liberal 
\end{DoxyAuthor}


\-Definition at line 16 of file \-Robots\-Parser.\-java.



\subsection{\-Member \-Function \-Documentation}
\hypertarget{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a763eb021063080b7cbfc3a0477b89b38}{\index{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}!robot\-Safe@{robot\-Safe}}
\index{robot\-Safe@{robot\-Safe}!com::spider::jspiderlibrary2::RobotsParser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}}
\subsubsection[{robot\-Safe}]{\setlength{\rightskip}{0pt plus 5cm}static boolean {\bf com.\-spider.\-jspiderlibrary2.\-Robots\-Parser.\-robot\-Safe} (
\begin{DoxyParamCaption}
\item[{\-U\-R\-L}]{url}
\end{DoxyParamCaption}
)\hspace{0.3cm}{\ttfamily  \mbox{[}static\mbox{]}}}}\label{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a763eb021063080b7cbfc3a0477b89b38}


\-Definition at line 25 of file \-Robots\-Parser.\-java.



\-References com.\-spider.\-jspiderlibrary2.\-Robots\-Parser.\-D\-I\-S\-A\-L\-L\-O\-W.



\-Referenced by com.\-spider.\-jspiderlibrary2.\-Spider.\-process\-U\-R\-L().



\subsection{\-Member \-Data \-Documentation}
\hypertarget{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a0d4b2f94e6784a8bff783928ef5d5a78}{\index{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}!\-D\-I\-S\-A\-L\-L\-O\-W@{\-D\-I\-S\-A\-L\-L\-O\-W}}
\index{\-D\-I\-S\-A\-L\-L\-O\-W@{\-D\-I\-S\-A\-L\-L\-O\-W}!com::spider::jspiderlibrary2::RobotsParser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}}
\subsubsection[{\-D\-I\-S\-A\-L\-L\-O\-W}]{\setlength{\rightskip}{0pt plus 5cm}final \-String {\bf com.\-spider.\-jspiderlibrary2.\-Robots\-Parser.\-D\-I\-S\-A\-L\-L\-O\-W} = \char`\"{}\-Disallow\-:\char`\"{}\hspace{0.3cm}{\ttfamily  \mbox{[}static\mbox{]}}}}\label{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a0d4b2f94e6784a8bff783928ef5d5a78}


\-Definition at line 22 of file \-Robots\-Parser.\-java.



\-Referenced by com.\-spider.\-jspiderlibrary2.\-Robots\-Parser.\-robot\-Safe().

\hypertarget{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a0455347c6ace914cb64885d5cb4e051b}{\index{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}!\-S\-E\-A\-R\-C\-H@{\-S\-E\-A\-R\-C\-H}}
\index{\-S\-E\-A\-R\-C\-H@{\-S\-E\-A\-R\-C\-H}!com::spider::jspiderlibrary2::RobotsParser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}}
\subsubsection[{\-S\-E\-A\-R\-C\-H}]{\setlength{\rightskip}{0pt plus 5cm}final \-String {\bf com.\-spider.\-jspiderlibrary2.\-Robots\-Parser.\-S\-E\-A\-R\-C\-H} = \char`\"{}\-Search\char`\"{}\hspace{0.3cm}{\ttfamily  \mbox{[}static\mbox{]}}}}\label{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_a0455347c6ace914cb64885d5cb4e051b}


\-Definition at line 20 of file \-Robots\-Parser.\-java.

\hypertarget{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_ad78a55ba0cb474ee527ee4c2a73c3923}{\index{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}!\-S\-E\-A\-R\-C\-H\-\_\-\-L\-I\-M\-I\-T@{\-S\-E\-A\-R\-C\-H\-\_\-\-L\-I\-M\-I\-T}}
\index{\-S\-E\-A\-R\-C\-H\-\_\-\-L\-I\-M\-I\-T@{\-S\-E\-A\-R\-C\-H\-\_\-\-L\-I\-M\-I\-T}!com::spider::jspiderlibrary2::RobotsParser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}}
\subsubsection[{\-S\-E\-A\-R\-C\-H\-\_\-\-L\-I\-M\-I\-T}]{\setlength{\rightskip}{0pt plus 5cm}final int {\bf com.\-spider.\-jspiderlibrary2.\-Robots\-Parser.\-S\-E\-A\-R\-C\-H\-\_\-\-L\-I\-M\-I\-T} = 50\hspace{0.3cm}{\ttfamily  \mbox{[}static\mbox{]}}}}\label{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_ad78a55ba0cb474ee527ee4c2a73c3923}


\-Definition at line 23 of file \-Robots\-Parser.\-java.

\hypertarget{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_aff7a48bec0d0fa25e624afcc60144f32}{\index{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}!\-S\-T\-O\-P@{\-S\-T\-O\-P}}
\index{\-S\-T\-O\-P@{\-S\-T\-O\-P}!com::spider::jspiderlibrary2::RobotsParser@{com\-::spider\-::jspiderlibrary2\-::\-Robots\-Parser}}
\subsubsection[{\-S\-T\-O\-P}]{\setlength{\rightskip}{0pt plus 5cm}final \-String {\bf com.\-spider.\-jspiderlibrary2.\-Robots\-Parser.\-S\-T\-O\-P} = \char`\"{}\-Stop\char`\"{}\hspace{0.3cm}{\ttfamily  \mbox{[}static\mbox{]}}}}\label{classcom_1_1spider_1_1jspiderlibrary2_1_1_robots_parser_aff7a48bec0d0fa25e624afcc60144f32}


\-Definition at line 21 of file \-Robots\-Parser.\-java.



\-The documentation for this class was generated from the following file\-:\begin{DoxyCompactItemize}
\item 
src/main/java/com/spider/jspiderlibrary2/\hyperlink{_robots_parser_8java}{\-Robots\-Parser.\-java}\end{DoxyCompactItemize}
